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(57) Abstract 

A method of and an arrangement for aligning input (2) (Y-in; U-in; V-in) and output video sequences (3) (Y-out; U-out; V-out) of 
a video processing system (1). wherein histograms (4) are obtained representative of the occurrence of a plurality of discrete pixel values 
of pixels present in both the input and output video sequences (2; 3). Correction curves arc obtained by matching the histograms (4) of 
the mput and output video sequences (2; 3). By processing (5) the output video sequence (3) with the correction curves obtained, and 
comparing the input video sequence (1) and processed output video sequence (6). an objective video quality measure is obtained providing 
a closer match to a subjecUvely obtained video quality measure. 
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A Method and an Arrangement for Aligning Input and Output 
Video Sequences for Video Quality Measurement. 

Field of the Invention 

The present invention relates to video quality measurement 
and, in particular, to a method and an arrangement for aligning input and output 
video sequences of a video processing system such as a codec and video 
transmission channel. 

Background of the Invention 

In practice, video quality is measured by comparing, on a pixel 
by pixel basis, input and output video sequences of a video processing system. 

If the system under test changes in a global manner the 
contrast, the luminance or the chrominance signal of the input video sequence, in 
that all the frames are transformed in a like manner, a test person will Judge this 
as less disturbent than changes which are locally applied. Codecs which increase 
or decrease the brightness and contrast of the output signal without creating an 
annoying difference, are examples of such a system. 

If the video processing system performs a simple linear 
transformation, the processed or degraded output signal can be relatively easily 
corrected by applying inverse transformation. In practical systems, the 
transformation of the video processing system is non-linear and complicated, such 
that an inverse transformation is not always applicable. 

Quality measures which do not use inverse transformation 
will always show a lesser correlation than quality measures which do use a type 
of inverse transfomiation in order to compensate the video output sequence. 



wo 00/30366 



PCT/EP99/07908 



2 

UpttI now, there is no generally applicable and perceptively 
justified manner of calculating the inverse transformation of a video processing 
system. A linear approach is most often used in practice, however, with the risk 
of a too less correlation between subjectively and objectively measured video 
quality. Further, video sequences are bounded signals. In case of an input signal 
having a large contrast compared to the output signal, transformation. If linear, 
would lead to a mapping out of the applicable range. 

Summary of the Invention 

The present invention aims to overcome the above 
disadvantages of the prior art by providing a method of aligning input and output 
video sequences of a video processing system, wherein histograms are obtained 
representative of the occun-ence of a plurality of discrete pixel values of pixels 
present in both the input and output video sequences, and wherein a correction 
curve is obtained by matching the histograms of the input and output video 
sequences. 

With the method according to the invention, a non-linear 
correction curve can be obtained, such as an S-type transformation curve of a video 
processing system. 

By neglecting the correction curve, the objective quality 
measure obtained from the input and output video sequences will provide a too 
large difference, in those cases wherein a human observer will judge a difference 
in brightness and contrast, of an S-curve. not relevant for the quality of the video 
processing system under test. 

In a preferred embodiment of the invention, the histograms 
are obtained by counting the cumulative relative occurrence of pixel values of the 
plurality of pixel values for each of the video sequences. That is, for each pixel 
value the cumulative percentage of occurrence in a video sequence is calculated, 
i.e. the sum is calculated of the percentages of the pixel values less than or equal 
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to the current pixel value. The plurality of pixel values preferably ranges from a 
first value equivalent to a black pixel upto a last value equivalent to a white pixel. 

In an embodiment, the pixel values are taken from a bounded 
domain having values ranging from 0 = black to 255 = white and any Intermediate 
integer value. 

In a further preferred embodiment of the method according 
to the invention, the correction curve is obtained by matching pixel values of the 
histograms of the input and output video sequences of which the cumulative 
percentages are as equal as possible. 

Starting from a pixel value in the histogram of the output video 
sequence, for example, it is not likely that their will exist a pixel value in the 
histogram of the input video sequence having exactly the same cumulative 
percentage. Accordingly, in a further embodiment of the invention, interpolation 
between pixel values of the histogram of the input video sequences is provided in 
order to obtain an exact match of the cumulative percentages. A linear interpolation 
provides suitable results. 

By starting from the pixel value in the middle of the domain 
of pixel values of a histogram, matching problems due to small percentages or 
fractions are avoided. 

According to the invention, correction curves may be obtained 
for any of the luminance and chrominance signals of the input and output video 
sequences. 

By processing the output video sequence using the correction 
curve or curves obtained, and comparing the input video sequence and processed 
output video sequence a quality measure is obtained which matches in a optimum 
manner subjectively obtained video quality measures. 

The invention relates further to an arrangement for perfomiing 
the method described above, comprising means for obtaining histograms of both 
the input and output sequences, and means for matching the histograms to obtain 
a correction curve for a video signal. 
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The above and otherfeatures and advantages of the present 
invention will be readily apparent to one of ordinary skill In the art from the following 
written description when read in conjunction with the drawing. 

Brief Description of the Drawings 

Figure 1 shows, in a schematic representation, a video system 
of which the video quality has to be measured. 

Figure 2 shows, in a schematic representation, an embodiment 
of an arrangement according to the invention used with the video system shown 
in figure 1. 

Detailed Description of the Embodiments 

The video system 1 of figure 1 represents video processing 
systems such as a codec, a video transmission channel, etc. Input terminal 2 
receives an input or source video sequence, generally comprising a luminance input 
signal Y-in and chrominance input signals U-in and V-in. Output terminal 3 of the 
video system 1 provides an output video sequence, comprised of the output 
luminance signal Y-out and output chrominance signals U-out and V-out. 

Dependent on the type of video system 1 and its 
transformation function, the video sequence at the output terminal 3 is distorted 
or degraded compared to the input video sequence at the input terminal 2. 

Video quality is measured by comparing the input and output 
video sequences, using video quality measurement equipment (not shown). 

In order to obtain an as optimum as possible correlation 
between subjectively judged video quality, that is by one or more test persons 
looking to both the input and output video sequences, and the objectively measured 
video quality with the video quality measurement equipment, it is necessary to 
correct the output luminance and chrominance signals by a correction curve or 
curves, which depend on the input and output luminance and chrominance values. 
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In order to obtain such a correction curve or curves, according 
to the invention, histograms are obtained representative of the occurrence of 
discrete pixel values of pixels in both the input and output video sequences, i.e. 
the input and output luminance and chrominance signals. By matching the 
histograms thus obtained, the required correction curve or curves can be provided. 

To this end, in figure 2, histogram matching means 4 are 
shown, generally comprising suitably programmed processing equipment, for 
obtaining the histograms. 

In a preferred embodiment of the invention, the histograms 
are obtained by counting the cumulative percentage of occurrence of each of the 
pixel values in the input and output video sequences. The term cumulative denotes 
that the sum is calculated of the percentages of the pixel values less than or equal 
to the current pixel value. It is assumed that each pixel that is counted in the 
histograms is present in both the input and the output video sequences. From the 
histograms thus provided, a correction curve is obtained by matching pixel values 
of the histograms having the same or as optimum as possible the same cumulative 
percentage of occurrence. 

Assume a pixel having the value x and a cumulative 
percentage y in the histogram of the output video sequence. The means 4 are now 
programmed such that in the histogram of the input video sequence the pixel value 
x' is obtained having the cumulative percentage / which is the same or as best as 
possible the same as the cumulative percentage y. The correction curve is obtained 
by mapping x and x*. This procedure is repeated for the pixel values x-f1 , x+2, etc, 
such that all or nearly all the pixel values are mapped. 

It will be understood that in general there is no exact match 
of the cumulative percentages y and y*. in such a case, in order to obtain an exact 
match, the invention provides for interpolation between the pixel values of the 
histogram of the input video sequences, providing a pixel value x". The correction 
curve is than obtained by mapping x and x". 

In a preferred embodiment of the invention, the discrete pixel 
values range from the value 0, equivalent to a black pixel, uptil 255 which is 
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equivalent to a white pixel. Any intennediate integer value in this domain represents 
a pixel value. 

In order to avoid calculation of low percentages, it is preferred 
to start the matching process of the histograms in the middle of the domain, i.e. 
pixel value 128. By this, calculation too small fractions are avoided. At the pixel 
value 128, the risk of a non-zero percentage is small. By this calculation 
proceeding towards the ends of the pixel value domain one can ressort to a straight 
curve once the percentages are becoming too small. 

Although any type of interpolation is feasible, linear 
interpolation has found to provide satisfactory results. 

By processing the video output sequence at the output 
terminal 3 of the video system 1 , as schematically indicated by means 5 in figure 
2, a processed video output sequence at an output terminal 6 is provided. For 
obtaining a quality measurement, according to the invention, the input video 
sequence at input terminal 1 and the processed output video sequence at output 
terminal 6 are fed into a video quality measurement device (not shown). The video 
quality measure thus obtained has a much better correlation with subjectively 
established video quality measures than without the processing of the output video 
sequence using the correction curve or curves according to the invention. 

Those skilled in the art will appreciate that for the luminance 
and chrominance video signals different correction curves may be obtained, 
adapted to the characteristics of the video systems and/or perceptive measures. 

Although the matching of the histograms has been described 
starting from the output video sequence, it will be understood that the correction 
curves may also be obtained by starting from the input video sequence. 
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Claims 

1 • A method of aligning input and output video sequences of a 

video processing system, wherein histograms are obtained representative of the 
occunrence of a plurality of disaete pixel values of pixels present in both said input 
and output video sequences, and wherein a correction curve is obtained by 
matching said histograms of said input and output video sequences. 

2. A method according to claim 1 , wherein said histograms are 
obtained by counting the cumulative relative occurrence of pixel values of said 
plurality of pixel values for each video sequence. 

3. A method according to claim 2, wherein said plurality of pixel 
values ranges from a first value equivalent to a black pixel up to a last value 
equivalent to a white pixel. 

4. A method according to claim 3, wherein said pixel values are 
taken from a bounded domain having values ranging from 0 = black to 255 = white 
and any intermediate integer value. 

5. A method according to any of the previous claims, wherein 
said correction curve is obtained by matching pixel values of said histograms of 
said input and output video sequences of which the cumulative relative occurrences 
are as equal as possible. 

6. A method according to claim 5, wherein Interpolation between 
pixel values of the histogram of the input video sequence is provided in order to 
obtain an exact match of the cumulative percentages of the histograms of the input 
and output video sequences. 

7. A method according to claim 5 or 6, wherein said matching 
starts from the pixel value in the middle of the domain of pixel values. 

8. A method according to any of the previous claims, wherein 
separate correction curves are obtained for any of the luminance and chrominance 
signals of the input and output video sequences. 

9- A method according to any of the previous claims, wherein 

said output video sequence is processed by the correction curve(s) obtained, and 
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wherein said input video sequence and processed output video sequence are 
compared to provide a video quality measure. 

10- An arrangement for aligning input and output video sequences 

of a video processing system, comprising means for obtaining histograms of both 
said input and output video sequences, and means for matching said histograms 
to obtain a correction curve. 
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